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ABSTRACT 

This report describes and evaluates Project Impact, a 
magnet program that provided instruction in English as a Second 
Language and in Italian language skills, and bilingual instruction in 
science, mathematics, social studies, industrial arts, and 
secretarial studies to Italian speaking students of limited English' 
proficiency. The program, as implemented in 1980-81, aimed to develop 
En glish l anguage skills to effect a gradual transition into the 

ainstream within 2 years. Aside from instruction, the program 
provided for curriculum and materials development, counseling and 
supportive services, staff development, and parent involvement. 
Evaluation indicated that some gains were achieved in English 
reading, English listening comprehension, and Italian reading. 
However, irregularities in the pattern of gains and in correlations 
between pretests and posttests suggested that the achievement data in 
these areas were inconclusive. In mathematics, relatively significant 
gains were demonstrated. The attendance rate among students in the 
program was significantly greater than the rate for the entire 
school. To enhance program effectiveness, it was recommended that 
evaluation procedures be improved and that communication among 
schools with Italian bilingual programs be increased. ,(MJL) 
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A, SUMMARY OF THE EVALUATION 



FOR PROJECT IMPACT 
NEW UTRECHT HIGH SCHOOL 
. 1980-1981 



This magnet program, 1n its first year of funding, provided In- 
struction 1n E.S.L. and Italian language skills, as welLas bilingual' 
H Instruction in science, mathematics, social studies, Industrial arts, 
and secretarial studies to approximately 160 students of limited English 
proficiency in grades nine through twelve* Ninety-five percent of the 
target population were born in Italy and 100 percent spoke Italian at 
home as their first language* The students varied 1n educational pre- 
paredness, ability in their native language, and proficiency 1n English. x 

One of the major goals of the program was to expedite the acquisi- 
tion of the English language skills necessary for full ma 1nst reaming 
wlthtn an average span of two years* A gradual transition into the 
mainstream was accomplished by initially placing a student 1n one En- 
glish-only class, usually mathematics, then adding other classes as the 
student's proficiency in English increased* During this ^ime, each stu- 
dent was fully evaluated on a continuous basis* 

v Title VII funds supported administrative ank support services staff* 
All instructional services and paraprofessional assistance were provided 
byftax levy personnel* Curriculum materials were developed in the areas 
of computer science, secretarial* studies, and industrial arts and were 1n 
use in bilingual content-area classes* Supportive services to prbgram 
students consisted of personal and academic guidance, homd visits, and 
.vocational counseling* Development activities for staff members Included 
regularly scheduled department meetings and workshops and attendance at 
conferences on bilingual education* Parents of participating students 
were'invol ved through a Parent/Student/Community Advisory Committee and 
attendance at program and school-wide activities. 

Students) were assessed in English language development ( Stanford 
Achievement T£st ); growth 1n their mastery of Italian (teacher-made 
tests); mathematics (teacher-made tests); and attendance (school and 
program records)* Quantitative analysis of student achievement Indicated 
that: 

— In English reading, jii nth-, tenth-, and eleventh-grade students,' 
tested with Level II gwifcrally made statistically significant 
gains below the *05 level and were of moderate to great educa- 
tional significance* The small number of students, the pattern 
of score increases, and low or negative correlations, noted es- 
pecially in grades nine and ten suggest that these outcomes should 
be interpreted with caution* 



The gains made by ninth-, eleventh-, and twejfth-grade students 
tested on Level JJX^&pe-rwtr statistically significant. The " 
pattern of smiTl or negative gains between pre- and post-test 
scores at the upper range of the test suggests that Level III 
was too easy for the population tested. 

— In English 1 istenlnglcomprehenslon, only a small group of tenth- 
grade students tested with Level II demonstrated significant 
gains* Irregularities 1n testing or 1n scoring and reporting 
outcomes 1s suspected'for data reported 1n this area. 

r 

— (^In Italian reading, ninth, tenth, and eleventh graders demon- 
strated significant growth; twelfth-grade students did not. 
The low or negative correlations for ninth- and twelfth-grade 
results suggest the test was unreliable. 

-- In mathematics, ninth and tenth graders demonstrated signifi- 
cant growth 1n basic mathematical skills. However, the negative 
pre/post correlations for tenth-grade students suggest low test 
reliability. Tenth and eleventh graders demonstrated signifi- 
cant growth 1n geometry achievement at very high levels. / 

— The attendance rate of program students ^as-s1gnif1cantly greate 
than that of the entire student body. ^ , 



The following recommendations were aimed at improving the overall 
effectiveness of the program* 

-- Giving college credit (through local colleges and universities) 
for courses taken *by Project IMPACT students as an incentive for 
higher education; 

— Obtaining evaluation data as proposed in the areas of science, 
social studies, Industrial arts, and secretarial studies; 

Examining the conditions under which ±ests are administered, 
improving the procedures by which te£s are scored and outcomes 
reported, and reviewing the adequacy of teacher-made examina- 
tions 1n Italian reading and basic mathematical skills; 

' — Refinlog the record-keeping process for self-evaluation and 
future program, development; 

— Increasing communication with other secondary schools with 
Italian bilingual programs to share curriculum and materials 
and reduce the duplication of services. 
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I. DEMOGRAPHIC CONTEXT \ , ' 



New Utreclit High SchdoOs located in the Bensonhurst section of 
Brooklyn. It serves the Bensonhurst', Boro Park, Dyker Heights, and Bay; 
Ridge sections of the borough. Bensonhurst has the greatest concentra- 
tlon of Italo-Americans 1n the United States. This is easily observed 
by the number of Italian specialty shops in the area and the frequency 
in which one hears Italian and Its numerous dialects spoken in the vi- 
cinity of the school. Bay Ridge and Dyker Heights have many one-family 
fiomes of second and third generation Italo-AmeMcans, many of whom are 
professionals. The Boro Park section has also a strong orthodox Jewish 
community. The parents of these families, for the most part, send their 
children to religious schools. 

The neighborhood immediately surrounding the school is predominately 
working class residential with well-kept two- or three-family homes, small 

8 , J 
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apartment houses and some one-family homes. There are also numerous 
small stores and factories particularly along New Utrecht Avenue, The 
school is centrally located in Brooklyn and is very well served by pub- 
He transportation. The BMT subway is one half block from the school. 
There are also several bus lines which are within a short walking dis- 
tance. 

The school building and grounds occupy one full city block with 
track and athletic fields on New Utrecht Avenue. The school was built 
in 1925 and is well equipped with two fuM-st-zed gyms, a swimming pool, 
shops, music and art rooms, science and computer labs, etc., in keeping 
with a large city comprehensive hiqh school (grades 9 - 12). The build- 
ing has its fair share of qraffiti, and teachers have complained that 
some parts of the school have not been painted in over twenty years. 
Some classrooms still have the oriqinal stationary desks with ink-wells 
and over a half-century's worth of student carvings. Yet, overall the 
general appearance of the school is acceptable. \ 

The bili'pgual program shares an office with the foreign languages 
department. The bilinqual resource center is adjacent to the foreign 
languages office and serves as a- home base for the bilingual .staff and 
students. The resource center is well stocked with books, maqazines, 
reference books, curriculum guides, audio-visuals, etc. and is heavily 
utilized. Individual and group instruction, counseling, parent inter- 
views, and club meetings were all observed during site visits. The bi- 
lingual program has developed and continues to develop an outstanding 
collection of * Italian books in the Italian section of the school library 
whictrnot only serves the school population but also the Italian-speak- 
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1ng community at large. In addition,. the program has installed this 
year a full computer laboratory for the exclusive use of the bilingual 

y 

program students and offers computer science as part of the curriculum. 

The conminlty also offers a variety of resources throuqh Its many 
dvlc organizations: Catholic Charities, -CIAO, AMICO, and Italian Board 
of Guardians. These organizations are utilized fully by the family 
assistants of the program, w ~ 

The High School Language Survey taken during the school year 1979- 
1980 by the Office of Bilingual Education for'the borough of Brooklyn 
shows that 17 of the 37 high schools (46 percent) 1n Brooklyn, have a 
total of 1,041 Tta11an-dom1nant. students 1n need of bilingual education 
(or some special service for students of limited English proficiency 
[LEP]). IMPACT txas been chosen to mket the needs of these LEP students 
by functioning as a magnet program for the borough of Brooklyn. New 
Utrecht HigK, School has been selected as the site for this magnet pro- 
gram because: 1t has had a successful history of Italian bilingual. ed- 
ucation; 1t 1s centrally located 1n the largest Italian-American com- 
munity 1n the nation; and 1t 1s easily reached by mass transportation. 

In District 20 as a whole, 49 percent of the Intermediate and 

high school population 1s of Italian heritage. Fifty-seven percent of 

the feeder school population 1n the district 1s eligible for "Free A Lunch 

♦ 

or "Reduced A Lunch." 

According to the Annual School Census, October 1980, New Utrecht 
High School's student body 1s composed of 15 percent black, seven per- 
cent Hispanic, one percent Asian, and 77 percent white students. Sixty- 
five percent of the schobl population 1s made up of Italian Immigrants 

-3- 
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or students of Italian heritage. Approximately five hundred of these 
students areJMmlted-Enqlish proficient. While 15 percent of New Utrecht's 
school body qualified as free lunch eligibles in 1977 (according to School 
Profiles ,- 1977,) only 13 percent were deemed eligible in 1980. 
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II, STUDENT CHARACTERISTICS 

N1nety-f1ve percent of the program students were born 1n Italy and 
100 percent of the students speak Italian at home as their first lan- 
guage. Most of the students have had their primary and some of their 
secondary education 1n Italy. 

Because there may be selective personal and environmental pressures 
.on students 1n urban communities, the composition of the student body may 
vary from school to school and grade to grade within a school. Table 1 
presents the* distribution by sex and grade of bilingual program students 
for whom Information was provided. 



Table 


1. Number and percentages of^students by sex and grade. (N=118) 




















PERCENT 




PERCENT 






GRADE 


MALE 


OF 


* FEMALE 


OF 


TOTAL 


PERCENT OF 




N 


GRADE 


N 


GRADE 


N 


ALL STUDENTS 


9 


16 


40% 


24 


60% ' 


40 


34% 


10 


12 


40% 


18 


60% , 


30 


25% 


11 


10' 


28% 


26 


72% 


36 


31% 
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12 


3 . 


25% 


9 


75% 


12 


10% 
f 


TOTAL 


41 


35% 


77 


65% 


118 


100% 



•The percentage of program students is highest in the ninth qrade 
and lowest in the twelfth grade. . 

•In all grades, the percentages of female students are higher than 
the percentages of male students. 
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Because so many of the bilingual program students are immigrants, 
their educational histories may vary considerably. Many have suffered 
interrupted schooling, or have received fewer years of education than 
theiKgrad^ level would indicate. Program students are reported by age 
and grade in Table 2. 



' Tab! e 2. Number of students by age and grade*. (N=117) 



A6E 


GRADED 9 


GRADE 10 


GRADE 11 


GRADE 12 


TOTAL 


14 v 










1 












21 


16 










" 30 


17- 3 


-4 


5 - 


^'1*^ "> ., 


Z'v - 


31 


16 


2 




it 




27 


I? — 






2 




4 


20 








2 


2 


2l 








i 


1 


TOTAL 


38 


30 


36 


13 


117 


PERCENT 

0VERA 6S*^ 
for imm 

GRADE 45% 


40% 


50% 


38% 


44% 



* Shaded boxes indicate the expected aqe range for each grade. 

-\ • . 

^.44 percent of the program students are overage for their grade. 



.The highest percentage of overage students occurs in the eleventh 
grade. 

Students come with a very wide ranqe of abilities/ in Italian—from 
minimum competency to highly literate. Their proficiency in English 
also ranges from no knowledge of English to'proficient,, Proqram students 
have little opportunity to use English outside the school settinq with 
their friends and relatives; Italian, is used exclusively. In school, 
students communicate in English in their mainstream classes and for part 
of the, time, depending on their proficiency, in their bilinqual cfasses. 
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The evaluator observed that English is used among students when discussing 
school -related activities, while they use Italian in relating personal 
experiences. Many of the program students, especially male, hold after- 
school jobs which often interfere with participation in after-school 
activities. • 

ENTRY CRITERIA 

» 

Project IMPACT serves the Italian-dominant students who: 

1. have recently arrived from Italy; 

2. score below the twentieth percentile on the English part of 
the Language Assessment Battery (LAB); 

3. request to be part of the program. 

Some of the participating students speak English. with sufficient 
competence to take most of their courses in the mainstream. They partic- 
ipate in the native language arts, guidance, and vocational training 
components of the program, and are included on the b'asis of student or 
parent request. Others who may have difficulties with English in their 
mainstream classes^ receive tax levy and Title 1/ P.S.E.N. financed indi- 
vidual assistance. 




V 
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III. PROGRAM DESCRIPTION 

IMPACT 1s a magnet bllfnqual proqram for Italian-dominant students 
presently serving 160 students, grades 9 throuqh 12. During the first 
year of funding, 90 percent of the program students lived in the attend- 
ance area of the school. As of June 1981, 60 new ninth and tenth graders 
have been recruited through an arduous effort of articulation with other 
secondary schools, not only in the attendance area, but borough-wide. 
There is a good possibility that this number will increase by the time 
recruitment is completed in September. For the 1981-1982 school year, 
the out*-of -district enrollment will make up about half of the number of 
studfents in the program. 

JMPACT offers full academic and career programs in grades 9 through 
12. Programming is uniform at each level with provisions made for extra- 
curricular activities. Students are placed in programs based on content- 
area needs aod not by grade level. Placement in Enqlish as a second lan- 
guaqe is determined by proficiency in Enqlish. 

PHILOSOPHY OF THE PROGRAM 

^The philosophy of bilingual education is very clearly transitional. 
According to the principal, "If students are to survive in American so- 
ciety they must function in English; (we) will not perpetuated a ghetto 
mentally." This statement is said to reflect the feelings of the entire 
staff of the bilinqual program. The principal went on to say that this, 
did not mean that one should not have pride in one's own culture and heri- 
tage. 
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HISTORyIoF BILINGUAL EDUCATION AT NEW UTRECHT / 

Although this 1s the first year of funding of IMPACT, New Utrecht 
High School had pioneered bilingual education for Italian-dominant stu- 
dents at the secondary level wlth.the Title VII CAPISCO Program which 
served as a model for other secondary schools with Italian-speaking pop- 
ulations. It 1s timely, therefore, that IMPACTJs now reaching out-of- 
distrlct and serving a wider range of students borough-wide as a magnet 
school and is offering a variety of vocational courses, 1n addition to 
the basic program of bilingual education. 

STAFFING PATTERNS 



\ 



Title VII funds finance one projector coordinator, three curriculum 
specialists, one teacher counselor, one teacher trainer, one secretary, s 
and two family assistants. All personnel 1n IMPACT are fully bilingual 
and certified in their fields. 

Tax levy funds finance all bilingual content-area, and E.S.L. classroom 
teachers. The program tries to place competent and certified bilingual 
teachers 1n each department. - If English-dominant bilingual teachers are 
used, Itallan-domlnanf paraprofessionals are utilized to compensate for 
lack of ful V^tt^lclency 1n Italian. 

The project coordinator is in charge of the bilingual program oper^- 

V 

tions. He 1s supervised by the assistant principal for foreign languages. 

\ 

Chart 1 illustrates how the bilingual program at New Utrecht is arranged 
organisationally. 
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Chart 1. Project IMPACT organizational chart . 
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IV. INSTRUCTIONAL OFFERINGS 
ENGLISH AS A SECOND LANGUAGE (E.S.U) 

r 

All students participating 1n the E.S.U program receive instruction 
In English which 1s scaled according to proficiency. Each class listed 
in Table Sheets five class periods per week. The materials in use are 
those prepared by the Institute for Modern Languages. Fifty-seven of the 
program students are enrolled in mainstream English classes. Some .students 

continue to get support through the Title I remediation pro'gram. 

\ * 



\able 3. E.SX. offerings: courses and laboratories 



COURSE TITLE/ NUMBER 
LEVEL OF CLASSES 

Basic English 1 2 



Basic English 2 1 

s \ Basic English 3 1 

Speech Lab. 1 1 

Speech Lab. 2 1 



Remedial main- 
stream English 1 

Mainstream English 1 



AVERAGE CLASS 
REGISTER 



DESCRIPTION 



27 

26 

23 
21 
19 

25 
22 



Development of listing, 
speaking, reading and 
writing skills in English. 



Development: of fluency, 
acquisition of native- 
like accent, intonation, 
and speech patterns. 
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NATIVE LANGUAGE INSTRUCTION 

\ 

J \ The main objective of the native language course 1s to improve na- 

i-vV-l-anguage skills, and enhance pride in one's own culture and heri- 

\ \ 

tage. \A11 of the 160 students in the bilingual program are enrolled in 

\ -ii- 
IS 



Italian language classes which meet five periods per week. 

LEP students who are weakier in Italian language skills because of 
low educational level or heavy dialectical influences are placed in the 
regular Italian foreign language^program 'levels I through IV. Students 
who have well developed skills in Italian are placed in the native lan- 
guage or travel and tourism classes,. It should be noted that although the 
travel and tourism course can be considered content area, one of its main 
objectives is to develop proficiency in commercial Italian. " 

Placement into the various levels of native language arts is deter- 
mined by teacher-prepared tests, stiident interviews, and analysis of ; 
short compositions written by the bilingual student. 

Table 4 presents a breakdown of native language classes. 



V 


Table 4. Instruction in native 1 


anguage arts. 










COURSE TITLE/ 
LEVEL 


NUMBER 
OF CLASSES 


AVERAGE CLASS 
REGISTER 


DESCRIPTION 


Italian I 


mainstream ' 
classes. 


4 


New York State syllabus 
for level I foreign lan- 
guage 


Italian II 


ma in st ream 
classes 


20 . 


\New York State level II 
\syl labus 


Italian III 


mainstream 
classes 


21 ' 


l^ew York State level III 
syllabus 


Italian IV 


mainstream 
classes 


20 


New York State level IV 
syl 1$bus 


c 

Native Language 
(advanced) ' 


3 


23 


Survey of Italian liter- 
ature and advanced gram- 
mar \ i 


Travel and tourism 
(advanced) 


* 1 


27 


ticketing, business 
letters, etc. 



* can also be considered content-area course 
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BILINGUAL CONTENT-AREA COURSES 

The bilingual content-area courses 1n mathematics, social studies, 
science, and secretarial studies follow the regular New York State syllabus 
Adjustments are made to each course to fit the needs of the bilingual stu- 
dent* In math, social studies, and jewelry making,, a team teaching ap- 
proach 1s used because no fully bilingual teachers were round in those 
areas* In science, business, and secretarial studies, one fully bilin- 
gual teacher is certified for each class. 

The focus in each of these content-area courses 1s to aim for com- 
plete transition into English. Transition should take place within a 
period of two to three years on the average, Table 5 presents a break- 
down of courses in the content areas. 

^ TRANSITION TO MAINSTREAM CLASSES 

One of the major goals of IMPACT is to make proqram students functlona 
in the, English lanquage and fn the mainstream cfasses within an averaqe : . 

9 

span of two years. Each student is fully reevaluated on a continuous class 
fication basis. Students In.the program are encouraged to enter the main- 
stream as soon. as possible. This} transition may be gradual.; beginning, for 
exampl^, with malnstreaming in mathematics and then adding other subject 
areas w^ien the student 1s ready. One hundred percent of the program stu- 
dents ^ take two or more content-area courses in English. All students are 
required to take music, art, and gym in the mainstream. In the bilingual 
content-area courses, the general rule 1s to Increase the use of English 
as the year progresses and at the same time make allowances for new en- 
trants with little proficiency 1n English. 
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t ' I Table 5. 


Bilingual 


instruction in content areals. 

1 


COURSE TITLE 


NUMBER OF 
CLASSES 


AVERAGE 
REGISTER 




PERCENT OF CLASS TIME Ilf 
WHICH ITALIAN IS USED 


MATH - Algebra 


2 


17 


60 


- Geometry 


1 • 


15 


40 


- Business Math 


1 


18 


70 


SOCIAL STUDIES 








- World studies 


1 


19 


- 


- American History 


1 


24 


- 


SCIENCE - Biology 


1 


27 


50 

» 


- Computer , 




17 


40 

• 


SECRETARIAL STUDIES 








- Typing ' 


1 


91 




- Steno > 




19 


50 


INDUSTRIAL ARTS 




> 




- Jewelry Making 




14 


T 30 


BUSINESS 








- Travel and. Tourism 




27 


50 
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In a soda! studies course observed by the evalustor 1n May, 1981,- 
i \ 
9.0\percent of the Instruction Was 1n English. A paraprofesslonal reviewed 

and translated Into Italian concepts that presented difficulty to the re- 
cent arrivals. Students were not afraid to respond 1n English and used 1t 
about 70 percent of the time. In computer science, all of the, materials 
and print-outs were 1n English and the teacher occasionally explained vari 
ous concepts 1n Italian to the less English proficient. Students useu En- 
glish with each other about 60 percent of the time. 

S1xty-f1ve percent of the program students have completed their En- 
glish as a second language requirement, but continue to receive s^me con- 
tent-area Instruction 1n their native language. Even when fully main- 
streamed, program students remain 1n some way connected with the program, 
be 1t 1n extracurricular activities, guidance, or native language arts; 

MAINSTREAM CLASSES 

All IMPACT students are enrolled 1n mainstream classes in physical 
education, art, and music. Criteria for entry Into other mainstream 
classes 1s based upon student's proficiency 1n English and in some case? 
subject matter. 

Transition Into the mainstream 1s gradual from two to three years 
on the average. Students are first given one subject 1n the mainstream, 
usually math. More classes are added as time goes on and proficiency in 
English is further developed. Students in the mainstream are always 
checked and assisted by the billnguaXstaff. Table 6 presents the main- 
stream classes 1n which program students are enrolled. 
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Table 6. 


Mainstream classes* 1n 


which program students 


are enrolled. 


, « 


COMPONENT/SUBJECT 


NUMBER OF 
STUDENTS 


CRITERIA FOR 
SELECTION 


OTHER COMMENTS 


Physical education 


160 


Universal 


Interpreters are used 


Math 




Proficiency 1n 
English & mattf 


For students 1n transition 


Social studies 

1 


95 


Proficiency 1n 
English & s.s. 


H 


Sciences 


73 


Profldencv 1n 
English & science 


4 ii 


Music 


38 ' 


Required 


ii 


Art ; , / 


42 


Required 


ii 


Industrial arts 


22 


Required prof. 1n 
English 


it 


Secretarial studies 


19 


Proficiency 1n 
English 


ii 



* All classss^meet five hours per week 
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NON-INSTRUCTIONAL COMPONENT 



CURRICULUM DEVELOPMENT 

Durlnq the first year of funding under Title VII, IMPACT staff has 
developed curriculum materials in Italian-language classes as wel> as 
unit Jand lesson plans for all of the bilingual courses. All of the cur- 
riculum materials developed by the program follow the guidelines developed 
by the New York City Board of Education, The followinq are content areas" 
for which curriculum rtaterials were developed during 1980-81, already in 
classroom use: computer science, typing, stenography, jewelry making, 
and * ravel and tourism. * 



During the past several years, New Utrecht High School has had an 
Italian bilingual program equipped with a resource center full of materi- 
als developed during its operation. The resource center also has audio- 
visual and instructional materials such as tapes, charts for science, math 
ematics, social studies, and native language arts, reference books and mag 
azines, tape recorders, film projectors, overhead projectors, and type- 
writers. 

The school also has developed a large collection of Italian books, 
kept at the school library, including Italian versions of Enqlish best 
sellers. These books and materials are widely used by the foreign lan- 



qram students and staff. 

PROGRAM PROJECTIONS FOR FUTURE GROWTH 

The following table illustrates the program's projected increase in 




guage students in mainstream, the Italo-American community, and the pro 



course offerings and enrollment from 1980-81 to 1981-82. 
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Table 7. Projected 


offerings and program enrollment* 




1980 * 81 


1981 - 8? 
r rejected 


Enrollment 160 


220+ 


Course No- of 


Sprtlon^ 


Proiected No. of Sections 


Sorial stndiPSv 
Math 

no til 


2 

Cm 


Q 4 


o 
c 


4 




1 


1 


Native language arts 


3 


5 


E.S.I, basic 


3 


4 


E.S.L. speech lab* 


2 


3 


Steno 


1 


1 


Typing 


1 


2 


Drafting 


0 


1 


Jewelry making 


1 


1 


Computer 


1 


2 


Travel 4 Tourism 


1 


1 

m 



In addition, IMPACT staff plans to develop bilingual curriculum in 



the following areas: 
1. woodwork; 
2*- building trades; 

3. architecture; 

4. social studies units; and 
5* hygiene* 
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SUPPORTIVE SERVICES 

There 1s an extraordinary amount of support for program students at 
New Utrecht High-School. In addition to the bilingual proqram staff, - 
many of the teachers, guidance counselors, and administrators schoolwide 
speak Italian. Thus, counseling is made possible not just by- specialists, 
but by^fehe entire school staff. 

Special emphasis is placed on career and vocational counseling. 
IMPACT is working on" a career questionnaire in Italian for program 
students. At present, most of the counseling is done on an oral basis. 
An occupational outlook manual is used. The program is also planning 
to establish contact with major Italian 2nd multi-national companies to 
provi de-program students with an opportunity for greater exposure in 
career choices. 

Special note must be made of the persistent efforts of the family 
assistants. They have been instrumental in articulating efforts to relo- 
cate ten earthquake victim families of program r tudents. They worked 
arduously with local welfare agencies in finding housinq, employment, and- 
medical care for these unfortunate families. 

The family assistants make home visits two or three times a week 

depending on need. In addition, families often come to the school to 

seek advice on matters such as employment, insurance applications, medical 

care, and personal family difficulties. Daily contact is also made by 

telephone. There are at least 40 telephone calls made each day concerning 

students 1 attendance and individual problems. Parents are also called to 

be reminded of parent meetings such as P.T.A. , Parent Advisory Council, 

and school functions. It was found from oast experience that letters 

are not enough to encourage full parental participation. 
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STAFF DEVELOPMENT . 

v All of the bilingual staff members participate 1n staff training 
activities, which include: 

1. workshops; 

2. meetings; and 

3. conferences. 

All Title VII staff members attend bi-weekly department meetings 
c; workshops conducted by the IMPACT coordinator, assistant principal for 
foreign .languages, or teacher trainer depending on topic* In addition 
to formal meetings, on-going staff training takes place dally between 
teachers and trainers. Some topics covered were: 

1. working with children; 
working with parents; 

3. cultural interaction; 

4. diagnosis and prescription; and 

5. personal and professional development. 

Pre-service orientation meetings were also qiven in September by 
the program coordinator to acquaint staff with IMPACT. 

The coordinator and all bilingual Title VII staff members attended 
the following conferences during the 1980-81 school year: 
T. Italian Bilingual "Educators Conference; 

2. State Association of Bilingual Education Conference; 

3. Career Education Conference sponsored by the Bureau of Bi- 
lingual Education, New, York City Board of Education; 

4. Columbia University Career Conference sponsored by the Bi- 
— llnqual Education Service Center (B.E.S.C.); 

5. The C1ty-w1de conference for Italian parents; and 
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6. Bilingual Conference sponsored by New York City Board of Ed- 
ucation, New York University, and the State Education Depart- 
ment. 

Individual staff members also attended many other conferences par- 
tlcular to their fields* I.e. conference on computer sciences, etc. 

PARENT PARTICIPATION 

The Parent/Student/Community Advisory Committee meets monthly and 
1s made up of ten members: six parents; three educators; and one stu- 
dent. Its function 1s to keep parents and community members Informed 
of program development and to gather input for program formation as 
well as encourage members to get Involved in the social affairs of the 
school. 

As a result of program efforts: 50 percent of the P.T.A. is com- 
prised of bilingual parents; all school notices are translated into 
Italian; 250 people attended the bilingual dinner dance; 750 community 
members attended the annual bilingual syposlum co-sponsored by the P.T.A. 
New Utrecht High School was well represented at the annual parent con- 
ference; and the sum of 4,000 dollars was collected for the Italian 
earthquake relief fund. The many 18 dollar contributions (symbolizing 
"life" in the Jewish tradition) reflected the support which non-program 
families gave to this project. 

Even with the tremendous success of the parental component, IMPACT 
continues to plan for further parental participation. In addition to 
the development of a parent handbook in Italian, the following classes 
are being planned for the near future: 

1. citizenship classes; 
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2. additional E.S.L. classes (Queensboro Community College 
presently runs an evening program); and 

3. community orientation classes. 
AFFECTIVE DOMAIN x 

Extracurricular Activities ^ 

Program students participate actively 1n the bilingual program and 
school-wide extracurricular activities. The Italian Club, the bilingual 
symposium, the IMPACT bilingual magazine, community drives, trips* parades, 
soccer, and tutoring elementary school bilingual pupils seem to be the most 
popular. 

Special mention should^ be made concerning IMPACT activities during 
Italian culture week. Program students toured the local elementary schools 
and presented special stage performances in Italian, not only to Italian bi- 
lingual students but to all students, thus promoting intercultural under- 
standing* 

Student Performance 

Three of the five graduating students went on to college, one went 
back to Italy, and one^oi ned the work force. One hundred percent passed 
the Italian regents examination. In addition, approximately three students 
are represented in ARISTA, the honor society; one student won first prize 
at the American Association of Teachers of Italian poetry contest; and others 
were awarded certificates of merit for Italian plays presented at city hall. 

Program students have been successful at obtaining summer jobs at bi- 
lingual banks, travej agencies, board of education offices, and summer immer- 
sion programs 1n Italian for Enqlish-speaklng students. 

« 
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VI. FINOINGS • 

• 4 

ASSESSMENT PROCEDURES, INSTRUMENTS, AND FINDINGS 

The following section presents the assessment Instruments and pro- 
cedures, .and the results of the testing to evaluate student achievement 
in 1980-1981. 

Students were assessed in English lanquaqe development, -growth in 

their mastery of their native language, ind mathematics. The following 

are the areas assessed and the instruments used: 

Reading 1n English —Stanford Achievement Test (Subtests:! Total 

Readlnq* Listening Comprehension, Primary 
Levels II, III) 

Reading in Italian— Teacher-made tests 

Mathematics Performance— Teacher-made tests in basic competency 

and geometry j 

Attendance— School and program records. 

The following analyses were performed: 

On pre/post standardized tests of English reading afid listening com- 
prehension, and Italian reading achievement statistical and educational 
significance are reported. 

Statistical significance was determined through the application of the 
correlated t-test model. This statistical analysis demonstrates whether the 
difference between pre-test and post-test mean scores is larqer than would 
be expected by chance variation alone: i.e. is statistically significant. . 

J 

This analysis does not represent an estimate of how students would 
have performed in the absence of the program. No such estimate could be 
made because of the inapplicability of test norms for this population, and 
tfienrnavaft comparison group. 
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Educational significance was determined for each test and/or grade 
level by calculating an "effect size" based on observed summary statistics 
using the procedure recommended by Cohen. 1 An effect size for the cor- 
related t-test model 1s an estimate of the difference between p re-test and 
post-test means expressed in standard deviation. units freed of the influ- 

A 

ence of sample size. It became desirable to establish such an estimate be- 
cause substantial differences that do exist frequently fail to reach statis- 
tical significance if the number of observations for each unit of statistical 
analysis 1s small. Similarly, statistically significant differences often 
are not educationally meaningful. 

Thus, statistical and educational significance permit a more meaninqful 
appraisal of project outcomes. As a ruTe of thumb, the following effect size 
indices are recommended by Cohen as guides to interpreting educational signi- 
ficance (ES): " 

a difference of 1/5 = .20 = small ES 

a difference of 1/2 = .50 = medium ES 

a difference of 4/5 = .80 = large ES 
Information is provided on the attendance rate of students participat- 
ing in the bilingual program compared with that of the total school popula- 
tion. 

Although the project reports serving 160 students, scores for Enqlish 
reading achievement were reported for 73 students, while outcomes for listen- 
ing comprehension in English were reported for 66. In reading in Italian, 61 



Jacob Cohen. Statistical Power Analysis for the Behavioral Sciences 
(Revised Edition]^ New York: Academic Press, 197 V 7 Chapter 2. 




students were reported. On teacher-made tests of mathematics in Italian, 
scores were reported for 12 students on the basic level and for 13 students 
in geometry. Attendance data were provided for 103 students. Achievement 
data in the areas of science/ social studies, industrial arts, and secretarial 
studies were not provided. 

»• The following pages present achievement in tabular form. 
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Table 8. English reading achievement * 

Significance of mean total raw score differences between Initial 
and final test scores In English reading achievement of Itallan- 
speaklnq students with full 'Instructional treatment on the 
Stanford Achievement Test (Total Reading, Primary Levels II and III). 

J" 

Pre-test Post-test 

Standard Standard Mean Corr. 



10\ 

11 

12 



Level 


N 


Mean 


Deviation 


Mean 


Deviation Difference 


Pre/post 


t 




ES 


II 
III 


2 
23 


45.5 
91.2 


13.4 

19„9 


lj00.5 
88.9 


- 20.V 55.5 
23.2 -2.3 


1.0 
.65 


11.0 
-.59 


.05 
NS 


7.78 


II 
III 


5 

14 


39.5 
100.2 


11.8 
16.0 


79.0 
106.2 


20.7 ^39.2 
20.9 f 6.6 


-.15 
.83 


3.43 
2.10 


.05 
.05 


1.52 
.56 




3 

18 


63.0 
96.0 


27.8 
20.8 


75.7 
98.2 


31. i 12.7 
14.6 2.2 


.93 
.46 


1.95 
.49 


NS 
NS 


1.10 


IK 


1 
7 








— INSUFFICIENT DATA— 










1 1 1 N 


104.9 


20.5 


102.6 


14.6 -2.3 


.79 


-.45 


NS 





.Ninth-grade students tested with Level II demonstrated a gain that was statistically 
and educationally significant but the number of students tested was^very small. 
Ninth graders tested with Level III showed a decline In achievement that was not 
statistically significant/ 

.Students demonstrated statistically and educationally significant achievement gains. 
The negative pre- te'st/post- test correlation for students tested with Level II 
suggests the possibility of test^unrel lability or Irregularities In the scoring or 
recording of students' scores. 

.Eleventh graders tested with Level II showed an educationally significant gain, but 
the number of students tested v.^s very small. 

.Students tested with Level III generai'.y did not demonstrate a significant gain. This 
may be due to the Inadequacy of the test level which appears to be too easy for 
students to show significant growth. 

,L <J j graders did not show significant growth. Level III was apparently too easy 
ftK|Cse students. 



Table 9. English listening comprehension, 

, » * 

Significance of mean total raw score differences between 
initial A and final test scores 1n native language reading achievement 
of students with full Instructional treatment on the 
Stanford Achievement Test (Listening Comprehension Subtest, 
" Primary Levels II and III). 

Pre-test Post-test 
Standard Standard Mean Corr. 

Grade Level N Mean Deviation Mean Deviation Difference Pre/post t £ ES 

9" II 2 15.09 2.8 16.5 5.0 1.5 1.0 1.00 HS - 

III 25 33.0 8.6 31.0 8.7 -2.0 .58 -1.26 NS - 

10 II 2 9.5 10.6 18.0 9.9 ' 8.5 1.0 17.0 .05 12.0 

III 13 36.4 7.1 36.2- 4.6 -.2 .55 -.09 NS - 



n ii NO DATA 



III 16 34.5 



7.5 34.9 4.8 .4 .59 .29 NS .07 



12 



II , i INSUFFICIENT DATA 



III 7 



36.0 4.7 35.4 4.7 .57 -.39 NS 



.Only tenth-grade students tested with Level II demonstrated significant 
gains, but the number of students tested was very small. 

.Irregularities In the testing of students or In the scoring and re- 
porting of outcomes 1s suspected for data reported In this table. 
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Table 10. Italian reading achievement. 



Significance of mean total raw score differences between Initial 
and final test scores 1n native language reading achievement of Italian- 
speaking students with full Instructional treatment on the teacher-made tests. 



Pre-test Post-test 









Standard 




Standard 


Mean 


Corr. 






ES 


Grade 


N 


Mean 


Deviation 


Mean 


Deviation 


01 f ference 


Pre/post 


t 


£ 


9 . 


18 


51.8 


24.5 


79.0 


12.8 


27.2 


.23 


4.64 


.001 


1.09 


10 


19 


71.1 


23.2 


80.6 


18.6 


9.5 


.82 


3.10 


.01 


.71 


11 


20 


64.1 


21.8 


73.8 


15.7 


9.7 


.73 


2.91 


.01 


.65 


12 


4 


68.5 


23.9 


85.0 


11.5 


16.5 


-.15 


1.18 


NS. 





•Students In grades 9, 10, and 11 demonstrated significant growth In 
Italian reading achievement. 

.The pre/post correlation for ninth-grade results Is low, suggesting 
low test reliability. 

.Twelfth-grade . tudents did not show significant growth In achievement. 

.The negative pre/post correlation for twelfth-grade results suggests 
that the test was unreliable. 



Tab 1 — Hath«na^t1cs^asi€-^oiBpeten^)-ach1evefflent < 



Significance of mean total raw score differences between 
initial and final test scores In native language reading achievement 
of students with full Instructional treatment on teacher-made 
tests of basic competency. 



Pre-test Post-test 
Standard Standard Mean Corr. 



Grade 


N 


Mean 


deviation 


Mean 


Devi atlon D1 f ference 


Pre/post t 


£ 


ES 


9 


5 


68.0 


2.7 


82.0 


9.7' 14.Cn 


.66 3.81 


.01 


1. 70 


10 


5 


58.6 


7.0 


82.0 


4.6 23.4 


-.46 5.25 


.001 


2.35 


11 
12 


1 
1 








—INSUFFICIENT 0ATA 
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•Ninth and tenth graders demonstrated significant growth In basic mathe- 
matical skills. 

.The negative pre/post correlation for tenth graders suggests low test 
reliability. 
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Table 12. Mathematics (geometry) achievement. 

Significance of mean total raw score differences between 
Initial and final test scores In native language reading achievement 
of Italian-speaking students with full Instructional treatment 
on teacher-made tests in geometry.'. 



J 



Pre-test Post-test 
Standard Standard . Mean Corr. 

Grade N Mean Deviation Mean Deviation Difference P re/post _t £ ES 

g l - INSUFFICIENT DATA-- 

10 4 54.0 15,7 81.8 11.9 27.8 .99 12.76 .001 6.3tf 

11 8 50.4 9.0 69.8 12.2 19.4 .54 5.21 .001 1.84 

12 NO DATA 



.Tenth and eleventh graders demonstrated significant growth in geometry 
achievement at very high levels. 



«3 / 
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Table 13. Attendance 



Significance of the difference between attendanc percentages of 
program students and the attendance percentage of the school* 



Average School-Wide Attendance Percentage: 65.3 



Grade 


N 


Mean 
Percentage 


Standard 
Deviation 


Percentage 
Di f ference 


t 


£ * 


9 


32 


83.3 


14.5 


18.0 


7.0 


.001 


10 


25 ' 


81.2 


25.5 


15.9 


3.1 


.0025 


11 


33 


84.0 


17.1 


18.7 


6.3 


.001 


12 


13 


78.8 


24.9 .. 


13.5 


3.9 


.001 


TOTAL 


103 


82.5 


19.6 


17.2 


8.9 


.001 



.The average attendance rate for program students was 82.5 percent. 
This rate exceeded the total high school rate (65.3 percent) by a 
margin that was highly significant. 

.Attendance rates were approximately the same each qrade. 

•The attendance rates of students 1n each grade exceeded the'total 
high school rate by a margin that was highly significant. 
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VII. CONCLUSIONS.'-AND RECOMMENDATIONS 

CONCLUSIONS 

The New Utrecht Project IMPACT, ^in it* first year of funding, 
provides a rich learning environment for program participants. The 
program offers a variety of courses not only in language skills acqui- v 
sition, but also fn the field of vocational training. These services 
are being expanded to accommodate Italian-speaking LEP students borough- 
wide. ^ 

During the three site visits made by the evaluator, key personnel 
were interviewed: the principal; many teachers; and quidance counselors 
(both ir the bilingual and mainstream programs). The overwhelming im- ;» 
pression is that the program has the support of the administration, 
teaching staff, and the entire community. The bilingual staff is highly 
qualified and dedicated. The project coordinator and the foreign lan- 
guage assistant principal have worked to articulate the coordination of 
recruitment of LEP students borough-wide and have searched for continued 
improvement of the program. . 

Some of the achievements of Project Impact during the 1980-81 academic 
year are the following: 

1. development of curriculum materials in the field of vocational 
education; 

2. expansion of bilingual materials and resources for the school 
library and program resource center; 

3. artitulation of a borough-wide recruitment program; 

4. attendance at major bilingual education conferences by staff; 
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5. • development of an outstanding parental and community partici- 

pation program; 

6. coordination of a fund raising drive for Italian earthquake 
victims (the sum of $4,000 was collected); 

7. , development of Innovative bilingual vocational courses such 

as travel and tourism, and computer science; 

8. coordination of an outstanding extracurricular and tutorial 
program; and 

0 

9. recruitment of qualified bilingual teachers 1n content areas, 
despite limited availability. 

Areas which are 1n need of Improvement are record keeping, testing, 
and reporting student performance. Achievement data were reported, 1n 
most areas, for less than half of the number of students served. Because 
of the small numbers of students reported and the problems of testing and 
measurement referred to 1n the tables of the flndlnqs section, no con- 
clusions can be offered as to *he effectiveness of instruction. In Enqlish 
reading, testing or scojring irregularities appear to have occurred in 
grades nine and ten, while the test level administered in grades eleven 
and twelve appears to have been too easy for students to demonstrate 
significant growth. Irregularities in the scores reported for listening 
comprehension in English made interpretation of the outcomes difficult/* 
In reading in UaMan, students in grades nine, ten, and eleven demonstrated 
significant growth, but the teacher-made tests appeared to function j 
unreliably in grades nine and twelve. Small numbers of students were re- 
ported as taking teacher-made tests in mathematics on a pre- and post-test 
bas1s# The gains made by those students were judqed to be statistically 
significant, although the correlations between pre- and post-test scores 

o 

were very low in one Instance and were moderate in two other cases (out 
of four groups reported). 
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The attendance rates^ of program students exceeded that of the whole 
school by a margin which was highly statistically significant. 

The test scores outcomes suggest that student achievement was generally 
strong and positive, but problems of testing, or limited data, made In- 
terpretation of the reported findings difficult, or may have masked actual 
achievement, 

RECOMMENDATIONS 

It 1s suggested that college credit for certain courses be qlven 
to program students which would be a strong incentive for attending 
college after graduation. Although there is no advanced placement in 
Italian, there are colleges and universities in the metropolitan area 
which offer college credit courses, taught at the secondary school. 
It 1s highly recornmended that the program staff investigate this oppor- 
tunity. 

As a result of interviews with program staff, the evaluation team 
felt that there were indications that student and program achievements were 
more than adequate. ^However, it would be beneficial to refine the record 
keeping process so that the details of program successes can be substantiated 
and are not forgotten with time. A log could be kept contrasting program 
students with students in the entire school, number of home visits made, 
name of parents contacted by phone, awards received by program students 
with details. This type of data would Drove valuable for future evalua- 
tions, future^ funding, and public relations campaigns as well as an effect- 
i ve^means of lleTT^vaTulitTon Tor" "fuWre program" development. 

Due to the^ paucity of materials available city-wide in Italian, 
it is strongly urged that more communication be established with other 
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secondary schools 1n the city, such as Grover Cleveland High School 1n 
Brooklyn, with bilingual programs 1n Italian. Curricula and materials 
can be shared, thus reducing duplication of efforts. 

Towards the Improvement of the documentation and evaluation of the 
program, the following recommendations are offered: 

a) In order to demonstrate the program's effectiveness, 1t 1s essen- 
tial that the program strive to document and evaluate student performance. 
Towards that end, it is Important that the program collect accurate Infor- 
mation on as many of the participating students as possible. The small num- 
bers reported in 1980-81 may not adequately or acurately reflect student 
achievement. 

b) The outcomes reported for the Stanford Achievement Test and the 
Listening Comprehension Subtest suggest that the program examine and ex- 
ercise more control over the conditions of testing, as well as the process 
of test scoring and reporting of test outcomes. Review of data sheets 
before submittal to the evaluators is recommended. 

c) The teacher-made examinations used in the areas of Italian reading 
and mathematics should be reviewed, since they appeared to yield results of 
variable reliability. The use of standardized instruments in mathematics 
(translated into Italian when necessary) 1s an alternative which should be 
considered. 

d) It 1s recommended that the program staff obtain achievement data 
of program students in the areas of science, social studies, industrial 
arts, and secretarial studies.* 
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e) The program would profit from a review and revision of its 
evaluation design and processes in light of program objectives and the 
outcomes reported for the 1980-81 year. As the prdject is fundamentally 
a strong one, it should benefit from a more rigorous evaluation. 
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